A hybrid adaptive MCMC algorithm in function spaces

The preconditioned Crank-Nicolson (pCN) method is a Markov Chain Monte Carlo (MCMC) scheme, specifically designed to perform Bayesian inferences in function spaces. Unlike many standard MCMC algorithms, the pCN method can preserve the sampling efficiency under the mesh refinement, a property referred to as being dimension independent. In this work we consider an adaptive strategy to further improve the efficiency of pCN. In particular we develop a hybrid adaptive MCMC method: the algorithm performs an adaptive Metropolis scheme in a chosen finite dimensional subspace, and a standard pCN algorithm in the complement space of the chosen subspace. We show that the proposed algorithm satisfies certain important ergodicity conditions. Finally with numerical examples we demonstrate that the proposed method has competitive performance with existing adaptive algorithms.Comment: arXiv admin note: text overlap with arXiv:1511.0583

MCDIP-ADMM: Overcoming Overfitting in DIP-based CT reconstruction

This paper investigates the application of unsupervised learning methods for computed tomography (CT) reconstruction. To motivate our work, we review several existing priors, namely the truncated Gaussian prior, the $l_1$ prior, the total variation prior, and the deep image prior (DIP). We find that DIP outperforms the other three priors in terms of representational capability and visual performance. However, the performance of DIP deteriorates when the number of iterations exceeds a certain threshold due to overfitting. To address this issue, we propose a novel method (MCDIP-ADMM) based on Multi-Code Deep Image Prior and plug-and-play Alternative Direction Method of Multipliers. Specifically, MCDIP utilizes multiple latent codes to generate a series of feature maps at an intermediate layer within a generator model. These maps are then composed with trainable weights, representing the complete image prior. Experimental results demonstrate the superior performance of the proposed MCDIP-ADMM compared to three existing competitors. In the case of parallel beam projection with Gaussian noise, MCDIP-ADMM achieves an average improvement of 4.3 dB over DIP, 1.7 dB over ADMM DIP-WTV, and 1.2 dB over PnP-DIP in terms of PSNR. Similarly, for fan-beam projection with Poisson noise, MCDIP-ADMM achieves an average improvement of 3.09 dB over DIP, 1.86 dB over ADMM DIP-WTV, and 0.84 dB over PnP-DIP in terms of PSNR.Comment: 25 page

Deep Unrolling Networks with Recurrent Momentum Acceleration for Nonlinear Inverse Problems

Combining the strengths of model-based iterative algorithms and data-driven deep learning solutions, deep unrolling networks (DuNets) have become a popular tool to solve inverse imaging problems. While DuNets have been successfully applied to many linear inverse problems, nonlinear problems tend to impair the performance of the method. Inspired by momentum acceleration techniques that are often used in optimization algorithms, we propose a recurrent momentum acceleration (RMA) framework that uses a long short-term memory recurrent neural network (LSTM-RNN) to simulate the momentum acceleration process. The RMA module leverages the ability of the LSTM-RNN to learn and retain knowledge from the previous gradients. We apply RMA to two popular DuNets -- the learned proximal gradient descent (LPGD) and the learned primal-dual (LPD) methods, resulting in LPGD-RMA and LPD-RMA respectively. We provide experimental results on two nonlinear inverse problems: a nonlinear deconvolution problem, and an electrical impedance tomography problem with limited boundary measurements. In the first experiment we have observed that the improvement due to RMA largely increases with respect to the nonlinearity of the problem. The results of the second example further demonstrate that the RMA schemes can significantly improve the performance of DuNets in strongly ill-posed problems

Bayesian imaging inverse problem with SA-Roundtrip prior via HMC-pCN sampler

Bayesian inference with deep generative prior has received considerable interest for solving imaging inverse problems in many scientific and engineering fields. The selection of the prior distribution is learned from, and therefore an important representation learning of, available prior measurements. The SA-Roundtrip, a novel deep generative prior, is introduced to enable controlled sampling generation and identify the data's intrinsic dimension. This prior incorporates a self-attention structure within a bidirectional generative adversarial network. Subsequently, Bayesian inference is applied to the posterior distribution in the low-dimensional latent space using the Hamiltonian Monte Carlo with preconditioned Crank-Nicolson (HMC-pCN) algorithm, which is proven to be ergodic under specific conditions. Experiments conducted on computed tomography (CT) reconstruction with the MNIST and TomoPhantom datasets reveal that the proposed method outperforms state-of-the-art comparisons, consistently yielding a robust and superior point estimator along with precise uncertainty quantification

The Non-Perturbative Quantum Nature of the Dislocation-Phonon Interaction

Despite the long history of dislocation-phonon interaction studies, there are many problems that have not been fully resolved during this development. These include an incompatibility between a perturbative approach and the long-range nature of a dislocation, the relation between static and dynamic scattering, and the nature of dislocation-phonon resonance. Here by introducing a fully quantized dislocation field, the "dislon"[1], a phonon is renormalized as a quasi-phonon, with shifted quasi-phonon energy, and accompanied by a finite quasi-phonon lifetime that is reducible to classical results. A series of outstanding legacy issues including those above can be directly explained within this unified phonon renormalization approach. In particular, a renormalized phonon naturally resolves the decades-long debate between dynamic and static dislocation-phonon scattering approaches.Comment: 5 pages main text, 3 figures, 10 pages supplemental material

A Deterministic Construction for Jointly Designed Quasicyclic LDPC Coded-Relay Cooperation

This correspondence presents a jointly designed quasicyclic (QC) low-density parity-check (LDPC) coded-relay cooperation with joint-iterative decoding in the destination node. Firstly, a design-theoretic construction of QC-LDPC codes based on a combinatoric design approach known as optical orthogonal codes (OOC) is presented. Proposed OOC-based construction gives three classes of binary QC-LDPC codes with no length-4 cycles by utilizing some known ingredients including binary matrix dispersion of elements of finite field, incidence matrices, and circulant decomposition. Secondly, the proposed OOC-based construction gives an effective method to jointly design length-4 cycles free QC-LDPC codes for coded-relay cooperation, where sum-product algorithm- (SPA-) based joint-iterative decoding is used to decode the corrupted sequences coming from the source or relay nodes in different time frames over constituent Rayleigh fading channels. Based on the theoretical analysis and simulation results, proposed QC-LDPC coded-relay cooperations outperform their competitors under same conditions over the Rayleigh fading channel with additive white Gaussian noise

Transpiration Dominates Ecosystem Water‐Use Efficiency in Response to Warming in an Alpine Meadow

As a key linkage of C and water cycles, water‐use efficiency (WUE) quantifies how much water an ecosystem uses for carbon gain. Although ecosystem C and water fluxes have been intensively studied, yet it remains unclear how ecosystem WUE responds to climate warming and which processes dominate the response of WUE. To answer these questions, we examined canopy WUE (WUEc), ecosystem WUE (WUEe) and their components including gross ecosystem productivity, ecosystem evapotranspiration (ET), soil evaporation (E), and plant canopy transpiration (T), in response to warming in an alpine meadow by using a manipulative warming experiment in 2015 and 2016. As expected, low‐ and high‐level warming treatments increased soil temperature (Tsoil) at 10 cm on average by 1.65 and 2.77°C, but decreased soil moisture (Msoil) by 2.52 and 7.6 vol %, respectively, across the two years. Low‐ and high‐level warming increased WUEe by 7.7 and 9.3% over the two years, but rarely changed WUEc in either year. T/ET ratio determined the differential responses of WUEc and WUEe. Larger T/ET led to less difference between WUEc and WUEe. By partitioning WUEc and WUEe into different carbon and water fluxes, we found that T rather than gross ecosystem productivity or E dominated the responses of WUEc and WUEe to warming. This study provides empirical insights into how ecosystem WUE responds to warming and illustrates the importance of plant transpiration in regulating ecosystem WUE under future climate change